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A new formulation of the filter-error method for estimating aerodynamic parameters 
in nonlinear aircraft dynamic models during turbulence was developed and demonstrated. 
The approach uses an estimate of the measurement noise covariance to identify the model 
parameters, their uncertainties, and the process noise covariance, in a relaxation method 
analogous to the output-error method. Prior information on the model parameters and 
uncertainties can be supplied, and a post-estimation correction to the uncertainty was 
included to account for colored residuals not considered in the theory. No tuning param- 
eters, needing adjustment by the analyst, are used in the estimation. The method was 
demonstrated in simulation using the NASA Generic Transport Model, then applied to 
the subscale T-2 jet-engine transport aircraft in flight. Modeling results in different levels 
of turbulence were compared with results from time-domain output error and frequency- 
domain equation error methods to demonstrate the effectiveness of the approach. 


Nomenclature 

a z normal acceleration [g] 

Cl lift force coefficient 

C m pitching moment coefficient 

c mean aerodynamic chord [ft] 

E[.\ expectation operator 

g gravitational acceleration [ft/s 1 2 ] 

I yy pitch moment of inertia [slug-ft 2 ] 

m mass [slug] 

N number of samples 

n x number of states 

n y number of outputs 

n$ number of parameters 

q body-axis pitch rate [rad/s] 

q dynamic pressure [lbf/ft 2 ] 

R 2 coefficient of determination 

S wing reference area [ft 2 ] 

t time [s] 


* Research Engineer, Dynamic Systems and Control Branch, MS 308. Senior Member AIAA. 
t Research Engineer, Dynamic Systems and Control Branch, MS 308. Associate Fellow AIAA. 


V true airspeed [ft/s] 

a angle of attack [rad] 

A increment 

S e elevator deflection [rad] 

S t . throttle 

< 7 standard deviation 

Subscripts 

o starting value 

Superscripts 

- 1 inverse 

T transpose 

time derivative 
estimated value 
| . | determinant 
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I. Introduction 


A ircraft parameter estimation consists of determining the values of unknown parameters in a known 
model structure to achieve the best match of model output to measured output data. For example, 
a common task is to estimate stability and control derivatives from small-perturbation maneuver data 
about a nominal flight condition. Maximum-likelihood estimation has evolved as a widely-accepted method 
for aircraft parameter estimation because of its superior theoretical properties and proven practicality. 1,2 
Maximum-likelihood estimators are divided into three categories according to their treatment of stochastic 
noise: output error accounts for measurement noise only, equation error accounts for process noise only, and 
filter error accounts for both process noise and measurement noise. 

Output error and equation error methods have had widespread and successful application to a variety 
of aircraft modeling problems, 3,4 whereas filter error has been seldom used, and with much more difficulty. 
One reason for this is that the former methods are considerably simpler than the latter, leading to easier 
implementation, lower computational costs, and a more straightforward verification of the modeling results. 
Also, techniques such as data smoothing and using frequency-domain data have been developed to improve 
and extend the applicability of first two methods. 1,5 In contrast, filter error can need higher levels of 
information content in the data and longer computation time, incur convergence and identifiability problems, 
require significant analyst judgment, produce inaccurate error measures, and mask some modeling problems 
by fitting the data too well. 

There are, however, occasions when both process and measurement noise manifest in the flight data and 
filter error becomes attractive or necessary. One such instance is flight in atmospheric turbulence. Because 
turbulence is difficult to measure and complex to model, and can significantly affect the motion of the aircraft, 
it is often modeled as stochastic process noise in aircraft flight dynamics, which makes the aircraft states 
stochastic quantities. Because including process noise considerably complicates the analysis, it is standard 
practice to instead perform flight tests only in calm air. This strategy can, however, lead to project schedule 
delays and increased costs when inclement weather is encountered. Some aircraft configurations and flight 
regimes are particularly susceptible to the effects of turbulence. Subscale aircraft, which are now commonly 
used for flight testing, have higher gust sensitives due to lower mass and inertia. Flexible aircraft, which are 
becoming more common because of associated fuel savings, have lightly-damped structural resonances that 
are easily excited by turbulence. Upset conditions, loss of control scenarios, and accidents are also often 
accompanied by turbulence. In such cases, filter error is an appropriate maximum-likelihood parameter 
estimation method because it accurately reflects the physics. 

This work presents a new formulation of the filter-error algorithm that can be used with general nonlin- 
ear dynamical systems. One strength of the proposed formulation is that it closely parallels the standard 
implementation of the output-error algorithm, which has been successfully applied to a large number of 
aircraft and flight maneuvers, and is thus familiar to use. The new formulation of the filter-error method 
employs a relaxation technique to alternate between estimating unknown model parameters using Gauss- 
Newton optimization, and estimating the process noise covariance matrix using state equation innovations, 
until convergence is achieved. The measurement noise covariance, which has a clear physical interpreta- 
tion, can be readily obtained using various methods to decrease the burden placed on the estimator. This 
formulation results in a relatively small number of unknowns, and exhibits accurate parameter estimation 
without convergence or identifiability issues. No tuning parameters, needing adjustment by the analyst for 
each situation, are included in this method. The method may therefore be applied in a straightforward and 
procedural manner to estimation problems. 

The paper is organized as follows. Section II poses the estimation problem for nonlinear dynamical 
systems considering both process noise and measurement noise. Section III places the current work within 
context of previous work in aircraft parameter estimation in turbulence. The proposed method is explained 
in Section IV. Section V presents modeling results for three different cases: 1) simulated data in light-to- 
moderate turbulence, 2) flight test data in light-to-moderate turbulence, and 3) flight test data in severe 
turbulence. Conclusions are then drawn and discussed in Section VI. 

Many of the tools used to generate results shown in this paper are available in the MATLAB® software 
package called SIDPAC (System IDentification Programs for AirCraft). 7,1 SIDPAC is bundled with Ref. [1] 
and is therefore publicly available. The SIDPAC toolbox was developed at NASA Langley Research Center 
and is continually expanded and improved. 
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II. Problem Description 


This section establishes the mathematical framework for the estimation problem considered. The aircraft 
flight dynamics are postulated as the nonlinear dynamic system 


x(f) = f (x(f), u(t), 9) + w (t) 

(1) 

y(t) = h(x(i),u(t),0) 

(2) 

Z W = y(*) + v(z) i=l,2,...,N 

(3) 


where x is the state, u is the control input, y is the model output, z is the measurement, and 9 is a vector 
of unknown constant model parameters. Vector functions f and h are known. Vectors w and v represent 
additive process noise and measurement noise, which are assumed to be mutually uncorrelated, zero mean, 
Gaussian white processes with spectral density and covariance Q and R, respectively, which are defined by 

E [w(ti)-w T (tj)] =Q {ti)S(ti-tj) (4) 

E [v(i)v T (j)] = R {i)5ij (5) 

Equations (1)— (2) are in continuous time and Eq. (3) is in discrete time, resulting in a continuous-discrete 
formulation of the system which accurately reflects measuring the aircraft outputs using a digital computer. 
The system is stochastic because the noise processes are random. Therefore, the initial state is specified by 
its mean and covariance 


x 0 = K[x(0)] (6) 

Po = E[(x(0) - x o )(x(0) - x 0 ) T ] (7) 


from which a state estimator is used to predict the resulting state and output history. As aircraft dynamics 
are routinely simplified to linearized equations, a Kalman filter is often used for state estimation. 8 

Parameter estimation involves determining the values of 9 such that the model output from Eqs. (l)-(2) 
best matches the measurements in Eq. (3). This can be done by maximizing the likelihood function 1 


C[z{i);9\ 


(27 r) n ' y l 2 \B(i)\ 1 ^ 2 • exp 


-~ v {i) T B(i) 1 v(i) 


( 8 ) 


where the innovation 

v(i) = z (i) - y(i) (9) 

is the difference between the measured and modeled output, and where B is the innovation covariance matrix. 
It is more convenient to minimize the negative logarithm of the likelihood function instead of maximizing the 
likelihood function directly (note that these optimizations are equivalent because logarithms are monotonic 
functions), resulting in the optimization cost function 

1 N 

J ( 6 ') = 2 X! v(i) T B(i)~ 1 v{i) + In \B{i)\ (10) 

i= 1 

The optimal model parameters minimize this cost function, which effectively minimizes the weighted sum of 
squares and covariance of the innovations, given the model structure and the measured data. 
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III. Parameter Estimation Methods 


This section discusses several methods for aircraft parameter estimation. First is the dual state/parameter 
estimation problem, followed by the output-error and equation-error methods, and finally the filter-error 
method. 

III. A. Dual State/Parameter Estimation 

The Kalman filter was originally conceived for optimal recursive state estimation for a linear system 
having Gaussian process and measurement noise. The dual estimation problem was then posed, where 
both the states and the unknown model parameters are estimated simultaneously. This is mechanized by 
augmenting the state vector with the model parameters, and appending 6 = 0 to the dynamic model 
equations. Because unknown parameters are now states, the dynamic system becomes nonlinear, and a 
nonlinear version of the Kalman filter must be used. 8, 9,10 However, issues related to tuning the Kalman 
filter, linearizing the nonlinear dynamic model, and making this method recursive lead to less accurate results 
than using non-recursive maximum likelihood methods. 11 Consequently, only parameter estimation in an 
off-line environment was studied in this work. 

III.B. Output Error and Equation Error 

Output error is a maximum-likelihood method, but it is a simplification of the problem stated in Section II, 
because process noise is neglected. The dynamic model is deterministic because Q = 0, and state estimation 
reduces to time integration. Gauss-Newton optimization is used to determine the model parameters, and 
an algebraic equation is used to estimate R. These unknowns are updated in an alternating manner called 
a relaxation technique, where one is held constant while the other is estimated. There is no proof that 
relaxation techniques converge, but this method has been applied successfully for many years with excellent 
results. 2,6,1 The assumptions employed in output error considerably simplify the estimation problem, which 
is one reason why output error is routinely used for aircraft parameter estimation. In addition, integration 
of the state equations is marginally stable with respect to the model parameters, which can lead to strong 
sensitivities and fast convergence of the estimator, given suitable starting values for the model parameters. 
The assumptions are also often very realistic because flight tests are usually conducted in calm air and 
because all sensors contain some measurement noise. Output-error solutions are, however, biased in the 
presence of process noise, which can result from unmodeled dynamics or turbulence. 6, 1 

Equation error is another maximum-likelihood method, but it is also a simplification because measure- 
ment noise is neglected. The estimation problem reduces to ordinary least squares, which has a non-iterative 
and analytical solution. The simplicity and speed of this approach are its strengths. However, this method re- 
quires additional techniques to remove noise from the explanatory variables to obtain unbiased solutions, 1, 12, 5 
and requires that all explanatory variables are either measured or reconstructed for the analysis. 

Some authors propose a blending of the parameter estimation methods, to combine strengths and mitigate 
weaknesses of the individual methods to attain superior results in the presence of both process and mea- 
surement noise. In Ref. [13], output error and equation error are combined using a user-selected weighting 
matrix to attempt to obtain accurate solutions with good convergence properties. Reference [14] describes 
an interactive program where the user selects feedback gains for the aerodynamic flow angles and body rates 
to adjust the ratio of process noise to measurement noise in an ad hoc fashion. 

Another approach for estimating parameters in turbulence is to treat the effects of turbulence as de- 
terministic, rather than stochastic. In this strategy, additional sensors can be used to measure or estimate 
the turbulence, which can then be supplied to the estimator as a known input. Reference [15] surveyed 
commercial sensors for this purpose, and developed methods to account for the effects of turbulence, using 
upwaslr factors and time delays in the measurements. 

A successful approach to parameter estimation in both calm air and turbulence has been to use equation 
error in the frequency domain. 1,16,1 ' Here, the data is transformed into the frequency domain using a 
narrow bandwidth encompassing only the dynamics of interest and the excitation. This step effectively 
removes the measurement noise and avoids other practical problems incurred when using equation error with 
time-domain data. A recursive formulation of the Fourier transform, combined with the speed of equation 
error and efficient testing techniques, 18 has led to successful real-time estimates during flight. However, this 
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method will produce increasingly biased parameter estimates as the turbulence level increases relative to the 
deterministic signal levels. 17 

III.C. Filter Error 

Filter error is the maximum-likelihood estimator that solves the problem described in Section II without 
further simplification. The complexity of estimating parameters for a nonlinear dynamical system in the 
presence of unknown levels of process noise and measurement noise, in addition to the standard challenges 
of model structure determination, uncertainty quantification, and adhering to modeling assumptions, has 
made the use of filter error for aerodynamic parameter estimation relatively rare. However, there have been 
advances and successes in applying filter error. As outlined by Maine and Iliff, 11 these can be categorized 
into the following three groups. 

The first group is called the natural formulation. Because the model parameters and noise covariance 
matrices are all unknowns, it follows naturally to attempt to estimate 0 , Q, and R that best match the model 
outputs to the measured output data. This approach led to high computational costs because of the large 
number of unknowns and complex interdependencies involved within the Kalman filter. More importantly, 
convergence issues and numerical singularities for Q were encountered. As a result, very few practical 
applications of this formulation have been reported, and these have usually required further compromises. 
For example, R was not estimated in Ref. [19], and Q was not estimated in Ref. [20]. 

The second group is called the innovation formulation. To circumvent problems associated with estimating 
noise covariances, 6 and the Kalman gain matrix K are instead estimated in an indirect manner. When 
estimates settle, B is updated using the relaxation technique, and the process repeats until convergence. The 
innovation formulation eliminated the convergence and numerical computation problems associated with 
the natural formulation, but introduced new problems. The Kalman gain matrix has n x ■ n y elements and 
is typically fully populated, which increases the number of unknowns and can lead to convergence issues. 
Elements of the Kalman gain have little physical significance, so finding adequate starting values and verifying 
solutions is difficult. Because the Kalman gain is estimated, a more sophisticated optimization method is 
needed to constrain values and keep the filter physically realizable. 

The third group is the Maine-Iliff formulation. 11 In this method, 0 and Q are estimated, followed by B , 
using the relaxation technique until convergence. This method reduces the computational load, removes the 
numerical singularities, and mitigates convergence issues that were incurred by the previous formulations. 
However, this method still requires a sophisticated optimization algorithm to ensure that the solutions 
correspond to realizable Kalman filters, and intuition is lost by indirectly solving for the unknowns. Of the 
relatively few implementations of filter error, the Maine-Iliff formulation has been the most popular. 21, 14,22 

IV. Proposed Formulation 


IV. A. Method 

Parameter estimation requires an adequate model structure and measured data with sufficient information 
content. Like output error, filter error poses a nonlinear estimation problem that requires good starting values 
for the model parameters $o, and an iterative optimizer. A separate estimate of R is used in this approach 
to reduce demands on the estimator, and reliable methods for doing so are discussed later. 

Although this formulation is applicable to general nonlinear systems, the problem is now specialized to 
linear time-invariant systems of the form 


x(f) = Ax(f) + Bu(f) + w(f) 

(11) 

y(t) = Cx(f) + Du(f) 

(12) 

z(*) = y(*) + v(i) * = 1,2,..., IV 

(13) 


because of their common use in aircraft analysis, control, simulation, and system identification, including 
the results presented later. The matrices contain constant elements that depend on 6 and known quantities. 

Similarly, a steady-state Kalman filter is used for state estimation because the noise statistics can be 
approximated as stationary for short durations of time. Unsteady or nonlinear variants of the Kalman filter 
can be used instead, without caveat, for other cases. The state covariance update equation reduces, in the 
steady state, to 

AP + PA T -PC T R _1 CP T + Q = 0 (14) 
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which is solved for P. The steady-state Kalman gain is then computed 


K = PC T R 1 (15) 

If no other information is available, Q is initially set to zero, which corresponds to output error. The Kalman 
filter has the a priori prediction 1,8 


x(t\i — 1) = Ax(f|i — 1) + Bu(t) (16) 

and the a posteriori measurement update 

x(*|i) = x(i\i — 1) + K [z (i) — Cx(iji — 1) — Du(i)] (17) 

at each time step. The state estimates are used in Eq. (2) or (12) to compute the estimated output. 

The innovations are then computed using Eq. (9), and their covariance is estimated as 

1 N 

B = (18) 

V i— 1 

which is the maximum likelihood estimate for a fixed 0. Although the Kalman filter also estimates the 
innovation covariance, Eq. (18) is preferred here because it is independent of the state estimator chosen and 
because modeling errors in the Kalman filter bias its innovation covariance estimate. Additionally, Eq. (18) 
produces a single matrix, instead of a time history of that matrix, which reduces computation. 

Gauss-Newton optimization is then employed to update the model parameter estimates. This optimiza- 
tion method is used in the output-error algorithm because it converges quickly near the solution and it is 
computationally tractable. 6, 1 The estimated output sensitivities 

SW= {^} for j = 1,2, . . . ,ne and k = 1,2, . . . ,n y (19) 

are numerically computed using central finite differences. Numerical computations are favored here over 
analytical derivatives for ease in changing the model structure. The cost function gradient and information 
matrix 

r)T N 

— =-^S(z) t B- 1 S (i) (20) 

i—1 

N 

M = ^ S(i) T (21) 

are computed and used to update the model parameters as 

- - r) T 

0 = 0o -NT 1 — (22) 

The covariance of this updated parameter estimate is then described by the Cramer-Rao lower bound 

cov(0) > MT 1 (23) 

This process repeats until changes in the parameter estimates, cost function, and cost function gradient 
settle within specified threshold values. Then the relaxation technique is employed to hold 0 constant and 
update Q. Although there are many sophisticated methods for estimating the process noise covariance, a 
simple method is used here. The process noise is reconstructed from Eq. (11) as 

w (t) = x(t) — A x(£) — Bu(f) (24) 

which should be zero-mean. The state derivatives can be obtained by smoothly differentiating the measured 
states. 5, 1 At the expense of convergence speed, unmeasured states can be substituted using estimates from 
the Kalman filter. The subtracted terms on the right side of Eq. (24) represent the modeled state vector 
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derivative, computed using the current model parameter estimates and the state estimates from the Kalman 
filter. Afterwards, the process noise covariance is estimated as 

i N 

Q = — ^w(i)w(i) T (25) 

V i—l 

which may be a fully populated matrix. The optimization then continues with the next iteration of model 
parameter estimation using this updated process noise covariance. Convergence is attained when changes in 
the model parameters, cost function, cost function gradient, and process noise covariance matrix all settle 
within specified threshold values. 

The formulation described in this section was implemented using MATLAB® software. The code was 
developed using the SIDPAC output-error program called oe.m as a starting point. 

IV. B. Practical Aspects of Implementation 

A few points in the proposed formulation warrant further discussion. The most outstanding is the 
assumption that the effects of atmospheric turbulence on the aircraft flight dynamics can be approximated by 
an additive Gaussian white noise process. Turbulence is inherently complex and its characterization remains 
an active field of research. Furthermore, previous efforts to accurately identify the gust spectrum introduced 
additional complexity in the estimator and were unsuccessful. 23 Filter error with process noise assumed to 
be white Gaussian noise is an approximate engineering solution, albeit with considerable complexity, to the 
problem under consideration. 

The second point pertains to starting the estimation algorithm. Unlike output error, where poor estimates 
of initial conditions could cause divergence, 24 state estimation is relatively robust to these errors and initial 
conditions can be selected as the first measurement, or otherwise reconstructed from those values. The 
problem of choosing initial covariance of the initial state is avoided here when selecting a steady-state 
estimator. Good starting values for the model parameters can usually be obtained from an equation-error 
analysis, wind tunnel tests, computation fluid dynamics, or engineering experience. 

The proposed formulation estimates 0 and Q for a known R. This is advantageous because it lowers 
the demands on the estimator and requires less information in the measured data. More importantly, it 
separates the residuals into components that are physical and well-modeled using covariance R, and other 
components that are approximated using the spectral density Q. The information contributed during this 
process can lead to more accurate parameter estimates and uncertainties than other simplifications of the 
maximum likelihood estimator. In output error for example, measurement noise and process noise, as well 
as any model structure error, are subsumed in R. These error sources are better accounted for using filter 
error. Many methods can be employed to determine R, including manufacturer data sheets and ground 
testing. A global method using optimal Fourier smoothing can also be used to accurately estimate noise 
characteristics from the flight data. 12, 1 Another simple technique is to average the spectral density of a signal 
over frequencies in which other responses, such as rigid body or structural dynamics, are small. Figure 1 
shows an approximation of the power spectral density of an output measurement. In the bands that are free 
from contributions other than measurement noise, the spectral density can be used to estimate R. 



i 

frequency [Hz] 2 At 


Figure 1. Approximation of power spectral density components 
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Another point concerns the estimated output sensitivities, which drive the convergence rate and determine 
the solution. In output error, state histories are computed via integration, which is very sensitive to changes 
in the model parameters. In filter error, where a state estimator is used instead, the feedback inherent in the 
Kalman filter reduces the sensitivity of the model output to the model parameters. While this is beneficial in 
state estimation applications, in parameter estimation it slows convergence for larger levels of process noise, 
which is exactly the case being considered. However, it was found that even for flight in severe turbulence, 
discussed later in Section V, the proposed formulation of the filter error method does not have convergence 
issues. This is in part due to a more accurate model structure resulting from the new formulation, which 
better poses the optimization problem and results in fewer local minima. 

This formulation of filter error can also incorporate prior information on the model parameters and 
uncertainty in a Bayesian framework. This is useful when combining results from different analyses, such as 
wind tunnel tests or a computational fluid dynamics analysis, or from different flight tests and maneuvers. 
The cost function, cost gradient, information matrix, and Gauss-Newton updates are augmented as 


m 


N 1 

E + In \B\ + 2 (0 - °p) T s; 1 (0 - e p ) 

2—1 

(26) 

BT N 

OQ = - E s(i) T *Hs(i) - S” 1 ( e - 0 P ) 

i—1 

(27) 

N 


m-E s « t ^” 1s « + s p 1 

(28) 

= 0o - (M + S; 1 )- 1 + S p 1 (0 O - 0 P )) 

(29) 


where 6 p and S p are the prior parameter estimates and covariance matrix. 

The last topic involves the accuracy of the estimated parameters, described by the Cramer- Rao bounds in 
Eq. (23). Output error is known to produce optimistic error bounds in the presence of colored innovations, 
which are not assumed in the theory but are routinely encountered with flight data, for example due to 
unmodeled dynamics. A method was developed for correcting these error bounds based on the coloring of 
the innovations. 25,1 This scenario is also true for filter error, where colored innovations are not assumed in 
the theory and lead to optimistic uncertainty bounds. This can be dangerous when using filter error because 
the match to the data can also be very good, which can give false confidence in the results. By extension of 
Ref. [25], the uncertainty bounds are corrected for the filter error problem by replacing Eq. (23) with 



N 

/ n y 

cov(ff) > M 1 

E s (o T s -1 
2—1 

1 '52Kw(i-j)B- 1 S(j) \ 


(30) 


where 


N-k 

fcw{k) = E v(i)v(i + k) T (31) 

i— 1 

is the estimate of the discrete autocorrelation matrix for the innovations. These calculations are done at the 
end of the estimation process, after the final parameter estimates are identified. 


V. Results 

This section presents the modeling results. The test aircraft and its nonlinear simulation are first intro- 
duced. Then the excitation inputs and the dynamic model structure are presented. Lastly, simulation and 
flight test results are discussed. Results obtained using the proposed formulation of filter error were compared 
with results from output error using time-domain data and equation error using frequency-domain data, be- 
cause these methods are popular and standard methods for aircraft parameter estimation. Uncertainties on 
all parameter estimates, for each method, have been corrected for colored residuals. 
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V.A. Test Aircraft and Simulation Model 


The test aircraft used is known as the T-2, and is shown in Fig. 2. The T-2 is a 5.5% dynamically-scaled 
transport-type airplane used in the NASA Aviation Safety Program flight test capability called Airborne 
Subscale Transport Aircraft Research (AirSTAR). The aircraft is piloted after takeoff by a research pilot 
in a mobile control room using synthetic vision displays drawn from telemetry data and a database of the 
local terrain. Control deflection commands are generated from the research pilot and the ground-based 
flight control system. Computer-generated excitation inputs for system identification are added to these 
commands just before the position and rate limiters for the actuators. 



Figure 2. T-2 aircraft in flight (credit: NASA Langley Research Center) 


The aircraft has 16 independent control surfaces, although these were moved as conventional elevator, 
aileron, and rudder surfaces in the present study. Measurements included body-axis translational accel- 
erations and angular rates, estimated Euler angles, differential GPS position and velocity, air flow angles 
from vanes mounted on wingtip booms, static and dynamic pressure, fuel flow rate, and control surface 
deflections. First-order anti-aliasing filters with cut-off frequencies at 16 Hz were used before measurement 
digitization. Data were telemetered to the ground station at 200 Hz, and downsampled to 50 Hz for analysis 
and modeling. For additional information about the aircraft and flight operations, see Ref. [26]. 

A high-fidelity, nonlinear, rigid-body, flight dynamics simulation of a test article similar to the T-2 
aircraft, called the NASA Generic Transport Model (GTM), was previously developed using wind tunnel 
tests conducted at the NASA Langley Research Center. A 5.5% scaled test article was used in the 14- by 
22-Foot Subsonic Tunnel under static and forced-oscillation testing to generate aerodynamic tables. These 
tables were augmented with data from rotary balance tests conducted using a 3.5% scaled wind tunnel test 
article in the 20-Foot Vertical Spin Tunnel. A polynomial-based aerodynamic model was then extracted 
from the data using multivariate orthogonal functions, 27,1 expanded in the aircraft states and controls, and 
is implemented in the simulation. The GTM also includes two turbojet engines, the dynamics for which are 
modeled as first-order lags from the pilot throttle input to the thrust output. 

V.B. Maneuver Description and Model Structure 

Three sets of data are presented. The first set uses a linearized model of the GTM to simulate flight in 
light-to-moderate turbulence. The second set uses a 13 s maneuver of flight test data in light-to-moderate 
turbulence from T-2 Flight 41. The third set uses five 13 s maneuvers of flight test data in severe turbulence 
from T-2 Flight 15. The simulation data was used to investigate algorithm performance in a controlled 
environment, but was devised to mimic conditions experienced in T-2 Flight 41. For each set of data, 
aircraft geometry and mass properties are listed in Table 1, and flight conditions are listed in Table 2. 

Orthogonal phase-optimized multisine inputs were used to simultaneously excite the elevator, aileron, and 
rudder during straight and level trimmed flight. This type of input was devised at NASA Langley Research 
Center and has led to the efficient identification of many aircraft in a variety of unusual flight conditions 
including hypersonic, high sideslip, stall and post-stall flight, as well as normal flight conditions. 18,1 The 
excitation used here lasted 10 s and contained frequencies between 0.2 Hz and 2.2 Hz, staggered in 0.1 
Hz increments. Control surface deflections were small enough to elicit responses appropriate for linear 
perturbation modeling, but large enough to produce good signal-to-noise ratios. The same input sequences 
were used in each set of data. 
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The longitudinal short period model was investigated, although the data also contained excellent infor- 
mation content for lateral/directional modeling. The linear state-space approximation for these dynamics 
and measurements is 1 
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(33) 


Airspeed, dynamic pressure, and mass properties inside the matrices are constant nominal values at the 
initial trim condition. The states are not necessarily perturbation values because bias parameters have been 
included to account for initial conditions and steady-state values. Additive process noise and measurement 
noise have also been included. The unknown model parameters to be estimated are the nondimensional 
derivatives and the biases 


e = 
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C„ 
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(34) 


although only the nondimensional derivatives are of interest. Estimating nondimensional derivatives removes 
the effects of known dependencies such as dynamic pressure. 


V.C. Simulation Results in Light-to-Moderate Turbulence 

A linearized model of the GTM was determined from the nonlinear simulation at the specified flight 
condition using central finite differences. The multisine inputs were used to excite the model. Process and 
measurement noise, having statistics extracted from the Flight 41 data in light-to-moderate turbulence, were 
used to corrupt the data. Additional colored noise in the frequency band [0,3] Hz and with amplitude equal 
to 5% of the root-mean-square value of each simulated output was added to simulate unmodeled dynamics. 
Although filter error can account for colored noise by augmenting the Kalman filter with a coloring filter, 
this was not done. The R used in the filter-error analysis was estimated using the spectral densities of the 
flight data between 10 Hz and 16 Hz. This range was selected because experience with the T-2 showed that 
effects of turbulence attenuated by 7 Hz, and the cutoff frequency for the anti-aliasing low-pass filters was 
set at 16 Hz. 

The simulation and analysis were performed 300 times, using unique noise sequences each time. One 
example run of the simulation data and the modeling result is shown in Fig. 3. The effects of turbulence 
are most evident during the quiet time before and after the excitation input. The measurements have 
high signal-to-noise ratios but also remain within the range for good linear modeling. The model outputs 
estimated using filter error had R 2 values above 0.99, making the measured and modeled outputs almost 
indistinguishable. The residuals had standard deviations less than 5% of the root-mean square of the signal 
variations. These metrics indicate an excellent modeling result. 

On average, the proposed method estimated standard deviations of R within 8% and Q within 18% 
of the true values used in the simulation. Because the method relies on the supplied measurement noise 
covariance to estimate the parameters and the process noise covariance, some error in the estimation of 
Q can be attributed to error in R. Again, output error and equation error absorb all the modeling error 
into either the R or Q matrix, respectively, and it is not expected that they match the true values. In 
terms of estimating noise statistics, the filter-error method proposed here estimated both sources, and did 
so more accurately, than either output error or equation error alone. The achieved level of accuracy is 
good, considering the presence of colored noise in the data and the robustness of the Kalman filter to 
modeling errors. The output error software typically converged within 21 iterations, whereas filter-error 
software typically used 24 iterations. This increase in computation time is small, especially compared to the 
increased accuracy gained from using filter error. 

The parameter estimation results for all 300 simulation runs are summarized in Fig. 4. The marker 
locations indicate the mean parameter estimates. The left bars show the estimated 2cr uncertainty in the 
model parameters using Eq. (30), and the right bars show the 2a scatter in the estimates from repeated 
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Figure 3. Measurements and model fit using filter error, Monte Carlo run 300 


experiments. Equal bars indicate an accurate prediction of the parameter uncertainty. All estimates are 
relatively accurate; however, errors are evident because process noise biases output error, measurement 
noise biases equation error, and unmodeled dynamics biases all three methods. In general, the filter error 
estimate had the most accurate parameter estimates. In addition, the filter error estimates had the smallest 
error bounds, was the only method that always produced estimates within statistical agreement of the true 
parameters, and was the method that most closely matched predicted uncertainty with observed scatter in 
the parameter estimates. 

Estimates of C mq for a few example Monte Carlo runs are shown in Fig. 5. The pitch damping derivative 
is often one of the harder model parameters to accurately identify. However, these results corroborate those 
in Fig. 4 and demonstrate that filter error consistently had more accurate estimates and smaller uncertainties 
which were also in statistical agreement with the true value. Estimates using output error and equation error 
exhibited more variation, larger error bounds, and degraded statistical agreement with the true value. 

The sensitivity of the filter error results to the estimated R was investigated. Results for C mq are shown in 
Fig. 6 for varying levels of error. For R too low, the Kalman filter weights the measured output data over the 
model output, and the parameter estimates began to diverge from their true values, until estimates no longer 
converged. This was also accompanied by an increased number of iterations needed for convergence. For 
R too high, the Kalman filter weights the model output over the measured output data, and the estimates 
of C mq were relatively insensitive until very large errors in R, although other parameters and indicators 
changed. A 40% error in the noise standard deviation was tolerated before the parameter estimates were 
no longer in statistical agreement with the true parameters. In practice, however, error margins for R will 
decrease due to uncertainty in the model structure. 

V.D. Flight Test Results in Light-to-Moderate Turbulence 

The T-2 aircraft was excited using a nrultisine input, starting from trimmed straight and level flight in 
light-to-moderate turbulence. The measured flight data, as well as the model fit using filter error, is shown 
in Fig. 7. The elevator waveform is very similar to that shown in Fig. 3. The small difference in starting and 
ending values is due to the pilot applying a small amount of back-pressure to the stick during the maneuver. 
The higher-frequency motion of the control surfaces are attenuated by the flight control system and actuator 
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Figure 4. Parameter estimation results for 300 Monte Carlo runs: marker = mean parameter estimate, left bar = 2<r 
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dynamics. The measured responses are also very similar, and again have high signal-to-noise ratios and good 
ranges for linear modeling. Modeled outputs using filter error had an R 2 value of 0.98, again indicating an 
excellent match. 



t [s] 

Figure 7. Measurements and model fit using filter error, T-2 Flight 41 

The estimated short-period parameters are shown in Fig. 8. The parameter estimates differed from those 
in Fig. 4 because those were computed from wind tunnel data and these were estimated from flight test data. 
The estimated parameters were consistent between the three methods. The output-error results predicted 
the lowest error bounds, but these results can be biased because of the turbulence. The equation-error results 
had the highest error bounds. The filter-error results represent a middle ground and were expected to be 
the most accurate results. 

The sensitivity of the model outputs to model parameter variations was investigated. Figure 9 shows the 
change in the pitch rate time history due to a change in the pitch damping derivative, for both output error 
and filter error. This plot confirms that integration using output error is about an order of magnitude more 
sensitive than Kalman filtering using filter error. Output error used 18 iterations to converge in this case, 
whereas filter error used 36 iterations. The decreased sensitivity of filter error resulted in more computation 
time than output error, but attained more accurate results. Balancing computation time versus better 
accuracy and uncertainty information is a trade-off that the analyst must make when choosing between 
output error and filter error for data collected in modest levels of turbulence. 

V.E. Flight Test Results in Severe Turbulence 

The T-2 aircraft was excited using a multisine input, starting from trimmed straight and level flight in 
severe turbulence. Five repeated maneuvers were considered. Measurements and model outputs using filter 
error are shown in Fig. 10 for Maneuver B. The elevator time histories differ slightly from those in Fig. 7 
because the pilot provided more input to keep the aircraft near the nominal flight condition. Measurements 
of the aircraft response are no longer smooth and now appear jagged, due to the effects of turbulence. 
Higher angles of attack, pitch rate, and normal acceleration were reached, which could degrade the linearity 
assumptions. However, filter error still produced an excellent fit to the measured data, having R 2 values 
above 0.98. 

Figure 11 presents an analysis of the angle of attack innovations for Maneuver B using filter error. The 
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Figure 9. Pitch rate sensitivity to pitch damping, T-2 Flight 14 


14 of 19 




American Institute of Aeronautics and Astronautics 







t [s] 

Figure 10. Measurements and model fit using filter error, T-2 Flight 15 Maneuver B 


assumption of normally-distributed disturbances can be visually inspected using Fig. 11(a), which shows the 
probability density of the innovations and an ideal Gaussian curve with the same mean and covariance. These 
residuals approximate a Gaussian distribution well and have R 2 = 0.95, which indicates that the Gaussian 
noise assumption is valid. The probability densities for the output error and equation error results had much 
larger standard deviations, multi-modal distributions, lower fits with an idealized Gaussian distribution, 
although this is conceded by the simplifying assumptions in these methods. 

The assumption of white noise can also be visually inspected using Fig. 11(b), which shows the innovation 
autocorrelation and the 2a confidence interval (computed as ±2'R. VV (0) / y/N) . Because this plot contains a 
sharp peak at zero lag and small values within the uncertainty band for most other lags, the white-noise 
assumption is valid. The autocorrelations for the output-error and equation-error results were an order of 
magnitude larger and had more data outside the confidence intervals. This indicated that the innovations 
were larger and had significant coloring. 
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Figure 11. Angle of attack modeling diagnostics using filter error, T-2 Flight 15 Maneuver B 


Figure 12 shows the modeling results for T-2 Flight 15. The output-error parameters exhibited a large 
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amount of scatter and uncertainty, especially in the damping derivatives, due to the high level of turbulence. 
The filter-error and equation-error results were much more consistent and accurate. The equation-error 
estimates of Cl u and C ma exhibited a shift from the Flight 41 estimates. This shift was also seen in Ref. [17] 
and is expected to be due to an unsteady dependence on the angle of attack. 28 Because filter error includes 
a more general and accurate characterization of the noise and system dynamics, parameter estimates from 
Flight 15 data in severe turbulence were more consistent with those from Flight 41 data in light-to-moderate 
turbulence. For the remaining stability and control derivatives, while some scatter and variability was seen 
in the estimates between maneuvers, the new formulation of filter error produced similar results as frequency 
domain equation error, which is known to produce excellent modeling results. 



Figure 12. Parameter estimates and 2a uncertainties, T-2 Flight 15 


Table 3 lists the parameter estimates and their uncertainties for T-2 flights 41 and 15 using filter error. 
The results here are similar and within statistical agreement of each other, and are similar to those estimated 
previously in Ref. [17] using equation error in the frequency domain. The uncertainties are lower for the 
Flight 15 results because more maneuvers were used in the estimation. The fact that consistent results were 
attained using filter error with flight test data under different levels of turbulence demonstrates that this 
implementation of filter error produced excellent modeling results. 

Table 4 displays the estimated statistics for the process noise and measurement noise using T-2 flights 
41 and 15. The measurement noise estimates were consistent between these two flights, which was expected 
because instrumentation did not change. The amount of process noise increased from Flight 41 to Flight 15, 
approximately doubling the diagonal components, which was expected from the higher turbulence rating. 
Similar to the metric developed in Ref. [17], turbulence levels can now be correlated with values for Q. 

VI. Conclusions 

A new formulation of the filter error method for estimating aerodynamic parameters in turbulence was 
presented. The method is designed for batch analysis, after all the flight data have been collected. It 
is applicable to general nonlinear systems, and any method of state estimation may be used. Given an 
estimate of the measurement noise covariance, a relaxation technique is used to alternately update the 
model parameters and the process noise covariance. This process is akin to that used in the traditional 
output-error algorithm, and is familiar to engineers and straightforward to apply. No ad hoc adjustments 
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of tuning parameters are used, so that the method can be applied consistently and accurately by different 
analysts. Prior information from other analyses and experiments can be supplied to the estimator in a 
Bayesian framework. A correction was included to account for colored residuals, which are not assumed in 
the theory. The formulation was implemented as MATLAB® software and runs using reasonable amounts 
of computation time, only slightly more than conventional output error. 

The method was applied to simulation data to understand the nature of the results. The method was also 
applied to flight test data in light-to-moderate turbulence and severe turbulence. Results were consistent 
between flights and performed better than time domain output error, and at least as good as frequency 
domain equation error. No convergence or identifiability issues were encountered. Modeling assumptions 
were demonstrated to be valid. Computed parameter uncertainty measures were shown to be consistent with 
scatter in the parameter estimates from repeated maneuvers. Fits of the model outputs to the measured 
output data were excellent. 

Although developed for general nonlinear dynamic systems, the discussion presented here was demon- 
strated using a linear dynamic model as a special case. This was done because aircraft parameter estimation 
routinely is used to estimate stability and control derivatives in linear models. Since linear models are often 
appropriate and noise statistics may be assumed stationary during standard maneuvers for system identifi- 
cation, a steady-state Kalman filter was also used. Nonlinear models and state estimators may however be 
used in their place. 

Knowledge of the measurement noise statistics is the only extra information needed by the analyst in 
this formulation of filter error. Because measurement noise has a clear physical interpretation and can be 
modeled well, and because there are several methods for accurately determining the measurement noise, this 
step is straightforward and not difficult to do. There is also some margin for error in this step, depending 
on the level of accuracy in the model structure. The benefit of this approach is that the estimator is relieved 
from having to estimate measurement noise, which makes the overall nonlinear estimation problem better 
conditioned and more accurate. In effect, the number of unknowns to be estimated is reduced because the 
measurement noise can be accurately estimated separately by other means. 

It was demonstrated that this filter error implementation can provide results superior to time domain 
output error, and at least as good as frequency domain equation error, when turbulence and measurement 
noise is present in the data. Unless both noise sources are substantial, however, the simpler methods should 
be preferred, to reduce computation time and analyst effort. However, if significant process noise exists, or 
all of the explanatory variables cannot be measured accurately or reconstructed, then filter error must be 
used. In addition to aerodynamic modeling in turbulence, other application examples include unsteady aero- 
dynamic modeling, where unobservable aerodynamic states are included in the model, linearized modeling 
in significantly nonlinear regimes, or flexible aircraft modeling, where modal states may not be available. 
In these cases, which are becoming more prevalent in flight testing, filter error can produce more accurate 
modeling results, in addition to providing more detailed information about the amplitude and nature of the 
noise sources. 
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Tables 


Table 1. Aircraft geometry and nominal mass properties 


Parameter 

GTM 

T-2 Flight 41 

T-2 Flight 15 

Unit 

c 

0.915 

0.915 

0.915 

ft 

S 

5.902 

5.902 

5.902 

ft 2 

m 

1.639 

1.639 

1.646 

slug 

lyy 

4.651 

4.651 

4.652 

slug-ft 2 


Table 2. Nominal flight 

conditions 


Parameter 

GTM 

T-2 Flight 41 

T-2 Flight 15 

Unit 

V 

140.7 

139.1 

136.0 

ft/s 

a 

4.000 

4.077 

3.893 

deg 

h 

1226 

1227 

1467 

ft 

St 

0.320 

0.290 

0.315 

— 


Table 3. Parameter estimates and uncertainties identified from T-2 flight data using filter error 


Parameter 

e 

T-2 Flight 41 
6 ± a (9) 

T-2 Flight 15 
d±a(9) 

c La 

+3.933 ± 0.073 

+3.828 ± 0.036 

c Lq 

+15.11 + 5.319 

+16.39 + 2.719 

c Lse 

+0.143 + 0.092 

+0.125 + 0.054 

Cm a 

-1.667 + 0.047 

-1.437 + 0.025 

C mq 

-46.36 + 3.712 

-44.76 ± 2.169 

Cm 5l , 

-1.676 + 0.070 

-1.722 + 0.040 


Table 4. Estimated measurement and process noise levels from T-2 flight data using filter error 


Parameter 

T-2 Flight 41 

T-2 Flight 15 

Unit 

std v a 

0.199 

0.232 

deg 

std v q 

0.260 

0.274 

deg/s 

std Va z 

0.046 

0.045 

g 

std w aa 

0.052 

0.099 

deg/s 

std w aq 

0.044 

0.063 

deg/s 3 / 2 

std Wqq 

0.152 

0.294 

deg/s 2 
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